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The  Coincidence  of  Measure  Algebras 
Under  an  Exchangeable  Probability 

By 

Richard  A.  Olshen 
Stanford  University 

1.  Introduction.  This  note  is  concerned  with  countably  infinite 
product  0-fields  and  their  invariant,  tail,  and  exchangeable  sub-pbfields . 
Under  an  exchangeable  probability  the  three  sub-o-fields  coincide  as 
measure  algebras  (the  theorems  (l)  and  (7))-  An  immediate  consequence 
is  the  Hewitt-Savage  0-1  law.  A  later  section  includes  examples  which 
by  and  large  preclude  extensions  of  (l)  and  (j)  to  probabilities  merely 
invariant  under  the  shift.  However,  at  least  one  interesting  conjecture 
of  David  Ereedman  remains  to  be  settled.  I  thank  him  for  helpful  con¬ 
versations  . 

The  results  presented  here  serve  to  clarify  and  extend  a  remark  by 
Halmos  about  power  product  probabilities  ([4],  p.  493).  They  also  extend 
a  theorem  set  forth  by  Meyer  ([7]*  P*  150 )  to  the  effect  that  in  a  uni¬ 
lateral  countable  product  space,  under  an  exchangeable  probability,  ex¬ 
changeable  and  tail  0-fields  coincide  as  measure  algebras.^ 

The  final  section  contains  the  answer  to  a  question  posed  in  the 
paper  [3]  by  Chung  and  Doob. 


1.  Meyer  attributes  this  result  to  Hewitt  and  Savage  [4],  and  indeed 
one  can  argue  that  it  is  implicit  there.  I  do  not  agree  that  it  is 
"the  main  result  of  Hewitt  and  Savage". 


2.  Rotation.  If  (ft,®)  is  a  measurable  space  and  I  is  either 
the  set  of  integers  (Z)  or  the  set  of  positive  integers  (Z  ),  then 
ft  =  ft(l)  =  ft1,  and  ®  is  the  product  g-field.  To  avoid  trivialities, 
assume  that  &  {0.,}}  .  Here  and.  in  the  remainder  of  the  note  it  refers 

to  a  fixed  permutation  of  I  which  leaves  all  but  finitely  many : members 
fixed.  To  each  it  corresponds  a  1-1,  bimeasurable  map  a^  of  ft  onto 
itself.  More  precisely,  if  weft  has  coordinates  w(i),  then 
(ajtw)(i)  =  u>(rt(i)).  The  set  E  is  exchangeable  provided  E  e  35  and 

a  E  =  E  for  each  jt.  The  collection  of  such  sets  is  a  cr-field,  the 

7t  „ 

exchangeable  a -field;  it  is  denoted  by  &.  Context  determines  which 
I  is  pertinent. 

The  shift  S  maps  ft  onto  itself  by  (Sw)(i)  =  co(i+l);  plainly, 

S  is  measurable.  If  I  =  Z,  S  is  1-1  and  bimeasurable,  while  if 
I  =  Z+,  it  is  decidedly  not  1-1.  And  in  the  latter  case  if  (ft,®)  is 
the  Borel  structure  of  a  Borel  set,  then  S  is  bimeasurable  iff  ft  is 
countable.  This  is  a  special  case  of  a  difficult  theorem  of  Purves  [8]; 
however,  it  is  rather  easy  to  give  a  direct  proof  based  on  the  fact  that 
there  exist  Borel  subsets  of  the  unit  square  whose  projections  on  an 
axis  are  not  Borel.  If  F  e  25  and  S  ^F  =  F,  then  F  is  invariant. 

The  invariant  sets  form  a  cr-field  the  invariant  cr-field.  As  with 
&,  the  notation  contains  no  reference  to  the  index  set  I. 

Suppose  J  c  I.  Define  ®(j)  to  be  the  cr-field  of  subsets  B  of 
S’  with  this  special  property:  if  w  e  B  and  w'(j)  =  u(j)  for  all 
j  e  J,  then  to '  e  B.  Of  course  &(!)  =  £B. 
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-f  * 

3*  The  case  I  =  Z  .As  the  heading  suggests,  throughout  this  sec¬ 
tion  I  is  the  set  of  positive  integers.  Define  the  future  tail  a- fie  Id  to  be 

CO  >  • 

S(i:  i  >  n),  and  denote  it  by  g  .  It  is  well-known  and  easily  proved 

~+  ~  . 

that  in  the  present  case,  g  eg,  and  the  inclusions  are  proper.  A 
probability  P  on  5s  is  an  exchangeable  probability  provided  B  e  T> 
implies  P(a_n.B)  =  P(B)  for  each  it.  A  consequence  of  the  following 

(V 

result  is  that  under  an  exchangeable  P,  &  and  g  are  identical  as 
measure  algebras . 

(1)  Theorem.  If  P  is  exchangeable  and  E  e  g,  then  P(EAS  ^E)  =  0. 
Proof.  Fix  y  >  0.  A  standard  result  from  measure  theory  insures 

the  existence  of  m  <  «>  and  W  e  33  (i:  l<L<rn)  for  which 

(2)  P(¥AE)  <  7  , 


where  A  means  symmetric  difference.  Define  a  „  on  ft  by 

IT* 


&  y  ^  y  ^  y  W  ,rsy  *  •  •  )  — 

ft*  1/  2^  nr  m+1  m+2 


(“m+1'  “l*  W2>  ***  V  Wm+2'  ^ 


Then  a^WAE  =.aj{#¥Aa^E  =  a^(WAE);  consequently 

(3)  P(a#¥A  E)  =  P(a#(¥AE))  =  P(¥AE)  . 

Wow  S  =  a^¥.  So  according  to  (2)  and  (3), 

(4)  P(S'1¥A¥)  ;=  P(a#¥A¥)  <P(a#¥AE)  +  P(EA¥)  <27  . 

Also, 
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(5) 


Pts"^  A  S_1E)  =  P(S_1(¥  A  E))  =  P(W  A  E)  , 

for  S  is .measure-preserving.  (It  is  enough  that  Pts'M  =  P(C) 

•when  C  is  a  cylinder,  and  this  is  given.) 

Finally,  (2),  (4),  and  (5)  together  say  that 

p(e  a  s_1e)  <  p(e  a  ¥)  +  p(¥as"1¥)  +  pCs'-Hjas"^)  <  by  .  o 


(6)  Corollary  (Hewitt-Savage  0-1  law).  If  P  is  a  power  product 
probability,  then  E  e  S  implies  P(E)  =P  (e). 

Proof.  Let  E*  =  lim  sup  S”5^.  In  view  of  (l),  P(EAE  )  =  0. 
low  E*  e  -Scg,  so  apply  the  Kolmogorov  0-1  law.  O 


4.  The  case  I  =  Z.  ¥hen  I  =  Z,  as  is  the  case  in  this  section, 
the  relationships  among  invariant,  tail,  and  exchangeable  a-fields  are 
not  so  simple  as  when  I  =  Z+.  In  fact,  there  are  several  tail  a-fields 
of  interest.  Clearly,  2s  can  be  defined  as  in  Section  3.  But. also 
the  past  tail  q-field  2s  merits  study,  where  2s  g,  ®(i:  i  <  -n) . 

Obviously,  g*  and  $  are  proper  sub-a-fields  of  2?*,  the  smallest 
0-field  containing  them  both.  I  learned  from  David  Freedman  (oral  comm¬ 
unication)  that,  also  g*  is  a  proper  sub-a-field  of  2s  =  ^  ®(i:|i|>n). 

He  begins  with  the  special  case  in  which  ®  has  four  members  as  follows. 

Let  6  -  (...5  6^,  8^,  ...)  be  a  (bilateral)  sequence  of  random 

variables  with  8^,  8-^,  . . .  independent  and  identically  distributed, 
and  P(S0  =  1).  =  P(80  =  -1)  = 
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Suppose  that  for  i  >  1^  8_^  =  S^(lj-g  =p] "-*•[§  =_i]^'  ^en  alg° 

8  ,8  ...  are  independent;  and,  by  the  Kolmogorov  0-1  law,  both 

"1  “2^ 

past  tail  and  future  tail  cf-fields  of  this  process  are  trivial,  but  for 
every  n,  &Q  is  determined  by  any  pair  {8^8^]  with  i^O,  hence  by 
{8i:  ] i |  >  n}.  Thus  g  is  not  trivial.  To  deduce  the  general  case, 
pick  Ae£B,  A  ^  ft,  0.  Fix  u^eA,  w2eAc.  For  B=£B,  let  P(B)  =0  if 
w  j£b,  P(B)  =1  if  w^sB,  w2eB5  =  2  otherw;L3e*  BY  a  variant 

of  the  Kolmogorov  0-1  law,  g  is  trivial  under  the  power  product 
probability  P  on  &(i:  i  >  0) .  Now  for  neZ,  let  gn(w)  =  1  if 
w(.n)eA,g  (w)  =  -1  otherwise.  Then  {gn)n  >  0  ~  *-5n^n  >  0;  wliere  x  ~  Y 
means  that  the  random  objects  X  and  Y  have  the  same  distribution. 

r^J 

It  is  a  very  special  case  of  the  Tulcea  extension  theorem  that  P  can 

be  extended. to  £8  in  such  a  way  that  {g  }  „  ~  {8  }  „  and  3  is 

*n  neZ  n  neZ 

trivial.  Thus  g  is  trivial,  while  g  contains  sets  of  probability 
—.  The  argument  that  g+  /  g  implies  a  result  in  [5]*  That  is,  if 
&n,  n-1, 2 , . . . ,  and  D  are  o-fields  of  subsets  of  a  fixed  space,  and 
under  a  fixed  probability  <2  -  ^  is  trivial,  it  does  not  necessarily 

follow  that  nQ1  (tfnVD)  and  C  V  D  coincide  as  measure  algebras.  (Of 
course  set-theoretic  inclusion  in  one  direction  is  clear.)  For  if  equality 
held,  from  two  applications  it  would  follow  that  under  P,  g  and  g 
coincide  as  measure  algebras.  Section  5  contains  a  strengthened  version 
of  the  foregoing  example. 

g  consists  precisely  of  those  measurable  sets  whose  measurability 
does  not  depend  on  any  finite  number  of  coordinates.  (This  characteri¬ 
zation  applies  to  g*  in  the  context  of  Section  5 • )  Patently,  S  c  % 
properly,  and  $  ^  ?T,  g_,  g,  6. 
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f-w  ivf  ivj  r*j 

(7)  Theorem.  Suppose  P  is  exchangeable.  Then  J}[  g  ,  S,  g, 

and  any  intersection  of  these  not  contained  in  g*  D  0} 

coincide  as  measure,  algebras. 

Proof.  The  argument  given  for  (l),  only  slightly  altered,  shows 
that  Ee'l  implies  the  existence  of  He  $>  satisfying  P(M)  =  0. 

Now  take  Fe3?,  and  fix  7  >  0.  There  exists  m  <  «  and 
Ge$(i:  |i|  <  m)  satisfying  P(FAG).  <  7»  So 

P(S~m(FAG))  =  P(FAS"mG)  <  7  , 

and  S-iriGe!B(i:  i  >  0) .  Thus  there  exists  G’eS(i:  i  >  0)  for  which 
P(FAGT  )  =  0.  Let  G*  =.  lim  sup  S_nG’.  Then  G  eS*  and  P(FAG  )  =  0. 

The  rest  is.  obvious .  O 

1  ■  . 

This  argument  shows  that  if  P  is  merely  invariant  under  the  shift, 
that  is,  if  P(S_1A)  =  P(A)  for  each  AeS,  then  as  measure  algebras 
Jc  g*.  Also,  xSc:  g  .  Rosenblatt  noticed  this,  in  [10] .  Krengel  and 
Sucheston  [ 6]  have  shown  more . 

5.  Generalizations .  Motivated  by  the  last  paragraph,  one  might 

hope  that  many  of  the  conclusions  of  (l)  and  (7)  still  hold  if  P 

is  not  exchangeable  but  only  invariant  under  the  shift.  The  following 

examples  substantiate  my  previous  assertion  that  most  of  the  conclusions 

no  longer  hold.  In  the  first  place,  g  need  not  coincide  with 

Assume  that  for  each  i  eZ,  5.  =  (...,  6.  .,  5.  6.  y,  ...)  is  a 

1 , -x  1,0  i,l 
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sequence  of  random  variables  distributed  as  ...  S_^,  &0,  8^,  ...  in 
the  last  section,  and  that  . .  .8^,  Bq,  ...  are  independent.  Let 

j£.  =  (...  y.  ^  o'  ^i  1  be  a  (bilateral)  sequence  of  sequences, 

■where  y. .  .  =  8.  ..  It  is  easy  to  see  that  the  ^  process  is  station- 

ary  and  that  its  future  tail  '  a-field  is  trivial  because  it  is  the 
smallest  q-field  containing  the  future  tail  of  each  8  sequence.  The 
past  tail  is  also  trivial.  But  the  observations  |i|>n}  determine 

every  5.  n  for  every  n,  and  so  the  q-field  corresponding  to  g  is 
as  rich  as  the  Borel  unit  interval.  Freedman  has  put  forward  the  at- 
tractive ■ conjecture  that  if  »  is  finite,  then  g_  and  g  conincide 
as  measure  algebras.  A  very  special  case  of  this  conjecture  will  be 
mentioned  at  the  end. 


One  direction  in  which  something  of  (7)  can  be  salvaged  is  the 
coincidence  of  g*  and  g  in  case  £  is  finite.  '  To  see  this, 
apply  Theorem  2  of  [9]  first  to  ^(i:  i<0)  and  S  then  to 
£(i:  IX))  and  S,  and  find  that  both  g"*"  and  g  correspond  to 
Pinsker's  maximal  partition  — —  what  Rohlin  and  Sinai  term  jt(T) .  Be 
warned  that  in  general  g  and  g  can  be  very  different.  For  sup¬ 


pose  . . .  x_^,  Xq,  x^,  ...  is  any  sequence  of  independent,  identically 
distributed,  nondegenerate  random  variables,'  and  for  i  e  Z,  r  = 

(...,  x^^,  xp„]f  xj)*  Then  CiO  is  stationary;  clearly  its  past 
tail  is  trivial,  and  its  future  tail  is  full.  Of  course  {r, },  as  well 
as  the  previous  can  be  realized  on  tbe  unit  interval.  And  note 

that  {r . 3  is  Markov;  the  remaining  examples  share  this  property. 
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It  is  hopeless  to  expect  and  g  ,  or  g_  ,  to  coincide.  A 

stationary  process  with  trivial  future  or  trivial  past  is  mixing  (see 
[13,  page  121,  or  [2],  Theorem  2),  and  there  are  stationary  Markov 
processes  which  are  ergodic  hut  not  mixing.  In  fact,  any  recurrent,  coun 
table  state  Markov  chain  with  stationary  transition  probabilities  and 
cyclically  moving  subclasses  has  a  nontrivial  future  tail  cr-field. 

Mich  more  is  shown  in  [2].  The  third  example  of  that  paper  is  a 
stationary  Markov  chain  with  three  states,  and  tail  and  exchangeable 
or -fields  which  do  not  coincide  as  measure  algebras.  While  the  paper 
treats  unilateral  processes,  the  conclusions  persit  in  the  bilateral 
case.  More  precisely,  Theorem  1  becomes:  if  •  [xn^ne2;  a  s^a^^ori” 
ary  Markov  chain  with,  countable  state  space,  and  A  is  determined 
measurably  by  the  x  ’  s  but  does  not  depend  on  any  finite  number  of 
them,  then  P(a|xq  =  i)  =  P  (a|xq  =  i)  for  each  state  i.  According 
to  the  extension  of  Corollary  1,  P(a|xq  =  i)  =  P(a|xq  =  j)  if  i  and 
«5  are  in  the  same  cyclically  moving  subclass.  Together,  these  facts 
and  the  aforementioned  Example  3  substantiate  the  assertion  about 

r+j  r*j 

g  and  6.  The  facts  along  with  the  results  of  [2]  also  serve  to 
establish  Freedman’s  conjecture  in  the  special  case  that  P  is  the 
measure  of  a  Markov  process. 
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6.  Intersections  and  products  of  a- fields.  The  distribution  of  the 


random  variables  8  in  Section  4  can  be  utilized  to  solve  a  problem  pre- 

viously  posed' ([?],  p.  4l4) .  Assume  that  ft  is  a  set  and  that  for  each 

real  t  g  is  a  cr-field  of  subsets  of  ft.  The  ftt's  are  nondecreasing. 

Let  2t  be  the  a-field  of  subsets  of  the  interval  (-c°,t],  and  for  real 

s  and  s'  let  S  x3  ,  be  the  product  cr-field  on  (-°°,s]  X  ft.  In  the 

s  s 

reference  cited  it  was  noted  that  for  each  real  a , 


fl 

8>0 


x  w  = 


n 

8  >  o 


(8  X  ft  _) 
v  a  a+8' 


However  there  remained  the  problem  as  to  whether  these  two  a- fields 


coincide  as  sets  with  8  X  5  ,  where  ft  =  fl  ft  R.  Meyer  has 

&  Q.  *  flT  c-s-  S+O 

0>  O' 

answered  the  question  affirmatively  when  the  product  fields  are  augmented 


by  the  null  sets  of  a  product  measure  on  &  X  ^  ft^,  where  is  the 


fix  V 

t 

Borel  cr-field  on  (-00,00) .  But  the  question  as  originally  posed  has  a  neg¬ 
ative  answer.  For  there  exist  a  family  of  a-fields  ft^  and  a  probability 

^  X  ^  ftj.  under  which  D  (^X  anti  x  do  not  coin- 

8  >  0 


on 


cide  as  measure  algebras . 

Let  ft'  =  {-1,1} ,  and  give  ft'  the  discrete  cr-field.  Let  Z'  =  Z+ll{0}, 
and  let  ft  =  (ft')Z  .  Give  ft  the  product  cr-field;  call  it  8.  The 
a- fields  $  (i:  i  >  n)  are  defined  as  in  Section  2.  For  ieZ'  and 

<V  ./V„  .  .  *tll  /v 

wen  let  X^(co)  =  u)(i),  the  i  coordinate  of  to.  There  exists  a  pro- 

bability  P  on  8  under  which  (Xq,X^, ...)  has  the  same  distribution  as 

*4"  th 

(&Q, in  Section  4.  For  ieZ  let  X  ^  be  the  i  Rademacher 
function  on  the  unit  interval,  so  if  ye [ 0,1]  X  i(y)  is  1  or  -1 
according  as  the  integer  j  for  which  j-l/21  <  y  <  j/P*  is  odd  or  even. 
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Extend  the  domain  of  definition  of  X^  to  the  interval  by 

X_1(y)  =  0  if  y  <  0. 

In  an  abuse  of  notation  the  X's  -will  be  viewed  as  functions  on 
(-00,1]  X  tf:  for  i  >  0  X1((y,u))  =  w(i),  and  for  i  <  0  XjL((y,u))  =  X±(y) 

It  is  easy  to  show  that  P  can  be  extended  to  ^  X  fB  in  such  a  way 
that  the  sequence  ...X  ^X^X^ . . .  has  the  same  distribution  as  the 
aforementioned  sequence  . . . . .  • 

Now  the  0^’s  'will  be  defined.  When  t  <  0  let  0^  =  {N,0);  when 
t  >  2  let  =  2  j  when  n  =  1,2,...  and  l/n+1  <  t  <  l/n,  let 
0  =  ®(i:  i  >  n-l) . 

For  each  6 >  0  the  event  A  =  [X^  =  1]  differs  by  a  P-null  event 

from  an  event  in  S,  X  g.,.,  Therefore  A  differs  by  a  P-null  event 

1  l+o 

from  an  event  in  fi  (S  X  0  ).  Now  suppose  that  there  exists  an 

S>  0  1 

event  B*  in  X  0^+  for  which  =  0.  This  assumption  will  lead 

to  a  contradiction  which  will  complete  the  argument  that  x  0^+  and 

fl  (®,  X  0  )  do  not  coincide  as  measure  algebras. 

8>  0  1  L  ° 

To  begin  fix  s,  0  <  e  <  l/2.  It  follows  from  elementary  arguments 

•j- 

that  there  exists  neZ  ,  B^,  ...,Bn  e  S^,  and  F^, ...,Fn  e  0^+  satisfying 

P(A  A  [  U  (B.  X  F. )])  <  £.  The  Kolmogorov  0-1  law  implies  that 
i=l  1  1 

P((-<»,1]  X  F)  is  0  or  1  for  each  F  e  0  .  So  for  each  fixed  i 

either  P<B±  X  F)  =  0  or  P((Bi  X  a)\(B±  XF.))  =  0.  With  no  loss  of 

generality,  assume  that  F^  =  2  for  each  i.  Moreover,  for  each  i  also 

P((B^  X  n)  \  ((B^  n[0,l])  X  ft))  =  0  because  this  event  is  a  subset  of 

[X__^  =  0] .  Again  with  no  loss  of  generality,  assume  that  each  B.  is  a 

n 

Borel  subset  of  the  interval  [0,1].  Thus  B  =  U  (B,  XF,)  is  determined 

.,11 

1=1 

measurably  by  {X  Clearly  A  and  B  are  independent.  Recall 
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that  P(A  A  B)  <  ~.  Now'  P(A  A  B)  =  P(A)  +  P(B)  -  2P(A)P(B).  Since 
P(A)  =  P(XQ  =  l)  =  ~  +  P(B)  -  P(B)  <  which  is  impossible. 

Loosely  speaking,  the  foregoing  construction  shows  that,  when  applied 
to  0-fields,  the  operations  countable  intersection  and  product  do  not 
commute.  It  would  be  interesting  to  know  whether  finite  intersection  and 
product  commute. 
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